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TNTHF CT ATMS: 

Please cancel claims 1-15 and 21-37. 

A clean version of the entire set of pending claims is as follows: 

16. (Once Amended) A computer comprising: 

a plurality of processes, wherein the plurality of processes service a destination address 
and have process addresses; 

a packet routing layer, wherein the packet routing layer routes a packets to the plurality to 
the plurahty of processes using a destination addresses within the packets; 

a dispatch layer between a TCP layer and an IP layer, wherein the dispatch layer has a 
plurahty of modes of operation including: 

a first mode of operation in which the dispatch layer receives a packet from a 
client, wherein the packet includes the destination address; 

a second mode of operation, responsive to receiving the packet, in which the 
dispatch layer identifies a process within the plurality of processes to service the cUent, 
wherein the process is an identified process; 

a third mode of operation in which the dispatch layer translates the destination 
address to a process address for the identified process within the plurality of processes; 
and 

a fourth mode of operation, responsive to the third mode of operation, in which 
the packet is sent to the packet routing layer. 

17. (Unchanged) The computer of claim 16, wherein each packet includes a source address 
and wherein the dispatch layer further includes: 

a fifth mode of operation in which the dispatch layer receives a packet from the identified 
process for the client; and 

a sixth mode of operation, responsive to the fifth mode of operation, in which the 
dispatch layer translates the source address in the packet of the destination address. 
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18. (Unchanged) The computer of claim 16, wherein the second mode of operation includes: 

a first submode of operation in which a determination is made as to whether a connection 
exists for the client; 

a second submode of operation, responsive to a determination that a connection is absent 
for the client in the first submode of operation, in which a connection is created and a process 
within the plurality of processes is assigned to service the connection, wherein the process is the 
identified process; and 

a third submode of operation, responsive to a determination that a connection exists for 
the client, in which a process assigned to the connection is identified and forms the identified 
process. 

19. (Unchanged) The computer of claim 1 6, wherein the packet routing layer is a 
transmission control protocol layer. 

20. (Unchanged) The computer of claim 1 6, wherein the plurahty of processes is a plurahty 
of server daemons. 

38. (Once Amended) A computer program product for routing packets fi-om a chent to a selected 
process within a plurahty of processes servicmg a connection between the data processing system 
and the client comprising: 

a computer readable medium; 

first instructions for receiving a packet for the connection between the data processing 
system and the chent, wherein the packet includes a destination address; and 

second instructions for translating, in a dispatch layer between a TCP layer and an IP 
layer, the destination address to an intermediate destination address, which is an address for the 
selected process within the plurahty of processes, wherein the instructions are embodies witiiin 
the computer readable medium. 
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REMARKS 



Claims 1-15 and 21-37 have been canceled. Claims 16-20 and 38 remain in the appUcation. 
These claims are beheved to be in condition for allowance. The amendments to claims 16-20 and 
38 were made in the Response to Office Action as filed on June 26, 2001 in the parent case 
09/161,905, No new matter has been added by these amendments. 

The examiner is invited to call the undersigned at the below-hsted telephone nimiber if in 
the opinion of the examiner such a telephone conference would expedite or aid the prosecution and 
examination of this application. 



Date: October 1 1, 2001 Respectfully submitted. 





DukeW. Yee 
Registration No, 34,285 
Carstens Yee & Cahoon, llp 
P.O. Box 802334 
Dallas, Texas 75380 
(972) 367-2001 

ATTORNEY FOR APPLICANT 
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Appendix of Claim Amendments 



16. (Once Amended) A computer comprising: 

a plurality of processes, wherein the plurality of processes service a destination address 
and have process addresses; 

a packet routing layer, wherein the packet routing layer routes a packets to the plurality to 
the plurality of processes using a destination addresses within the packets; 

a dispatch layer hetween a T CP l a yer and an TP layer, wherein the dispatch layer has a 
plurality of modes of operation including: 

a first mode of operation in which the dispatch layer receives a packet from a 

client, wherein the packet includes the destination address; 

a second mode of operation, responsive to receiving the packet, in which the 

dispatch layer identifies a process within the plurality of processes to service the client, 

wherein the process is an identified process; 

a third mode of operation in which the dispatch layer translates the destination 

address to a process address for the identified process within the plurahty of processes; 

and 

a fourth mode of operation, responsive to the third mode of operation, in which 
the packet is sent to the packet routing layer. 

38. (Once Amended) A computer program product for routing packets from a client to a selected 
process within a plurality of processes servicing a connection between the data processing system 
and the cUent comprising: 

a computer readable medium; 

first instructions for receiving a packet for the connection between the data processing 
system and the cUent, wherein the packet includes a destination address; and 

second instructions for translatin g, in a. dispatch layer hestween a TCP layer and an TP 
layer, the destination address to an intermediate destination address, which is an address for the 
selected process within the plurality of processes, wherein the instructions are embodies within 
the computer readable mediumu 
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INVENTORS: Andrew D. Dingsor and Stephen M. Pontes 

H METHOD AND APPARATUS LOAD 

BALANCING SERVER DAEMONS WITHIN A 

SERVER 

■; K 

BACKGROUND OF THE INVENTION 

5 Technical Field: 

The present invention relates generally to an improved 
distributed data processing system, in particular to a 
method and apparatus for improving perf omance and 
availability of a server. Still more particularly, the 
0 present invention relates to method and apparatus for 

improving server performance and availability of a server 
in a distributed data processing system through binding 
server daemons within the server. 
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Description of Related Art: 

Internet, also referred to as an "internetwork", in 
conimunications is a set of computer networks, possibly 
dissimilar, joined together by means of gateways that 
handle data transfer and the conversion of messages from 
the sending network to the protocols used- by the receiving 
network (with packets if necessary) . When capitalized, the 
term "Internet" refers to the collection of networks and 
gateways that use the TCP/IP suite of protocols. TCP/IP 
stands for Transmission Control Protocol/Internet Protocol, 
This protocol was developed by the Department of Defense 
for communications between computers- It is built into the 
UNIX system and has become the de facto standard for data 
transmission over networks, including the Internet. 

The Internet has become a cultiiral fixture as a source 
of both information and entertainment. Many businesses are 
creating Internet sites as an integral part of their 
marketing efforts, informing consumers of the products or 
services offered by the business or providing other 
information seeking to engender brand loyalty. Many 
federal, state, and local government agencies are also 
employing Internet sites for informational purposes, 
particularly agencies which must interact with virtually 
all segments of society such as the Internal Revenue 
Service and secretaries of state. Operating costs may be 
reduced by providing informational guides and/or searchable 
databases of public records online. 

Currently/ the most commonly employed mechanism of 
transferring data over the Internet is the World Wide Web 
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environment, also called simply "the web". Other 
Internet resources exist for transferring information, 
such as File Transfer Protocol (FTP) and Gopher, but have 
not achieved the popularity of the web. In the web 
environment, servers and clients effect data transaction 
using the Hypertext Transfer Protocol (HTTP) , a known 
protocol for handling the transfer of various data files 
(e.g., text, still graphic images, audio, motion video, 
etc.) , Information is formatted for presentation to a 
user by a standard page description language, the 
Hypertext Markup Language (HTML) . In addition to basic 
presentation formatting, HTML allows developers to 
specify "links" to other web resources, including web 
sites, identified by a Uniform Resource Locator (URL) . A 
URL is a special syntax identifier defining a 
communications path to specific information. Each 
logical block of information accessible to a client, 
called a "page" or a "web page", is identified by a URL. 
The URL provides a xoniversal, consistent method for 
finding and accessing this information by the web 
"browser". A browser is a program capable of submitting 
a request for information identified by a URL at the 
client machine. Retrieval of information on the web is 
generally accomplished with an HTML-compatible browser, 
such as, for example, Netscape Communicator, which is 
available from Netscape Communications Corporation. 

,A web site is typically located on a server, which 
in some cases may support multiple web sites. Many 
times, a web site can crawl when traffic on the web site 
is too heavy. As a result, popularity of a web site can 
be a detriment because the site cannot handle the amount 
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of traffic that the site is receiving. One mechanism 
used to increase performance of web site is to implement 
a server with more capacity and processing power or to 
employ multiple servers to handle the web site. With a 
larger server, a problem of single point failure is still 
present. If the server fails, the web site will be 
\inavailable until the server can be repaired or replaced. 
Multiple servers are employed to solve that problem. With 
multiple servers, however, the performance of the web 
site may be increased, but individual servers may be 
under utilized. In addition, the contents for a web site 
are replicated on each server. 

As a result, it is desirable to improve performance 
and availability of a server by load balancing among 
multiple server daemons rvinning on one seirver with all 
server daemons responding to the same IP address and port 
number. Presently, however, additional capacity to 
support increased throughput on one server machine can 
only be achieved with multiple seirver daemons bound to 
different IP addresses or port numbers. This situation 
is due to an architectural basic limitation in TCP/IP, 
wherein TCP can deliver a received packet with a unique 
destination address and port number combination to only 
one seirvrer daemon. 

Therefore, it would be advantageous to have an 
improved method and apparatus to increase availability and 
performance of a server without the different IP address 
and port number limitation. 
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SUMMARY OF THE INVENTION 



The present invention provides a method and 
apparatus in a data processing system for binding a 
plurality of server daemons to a destination address and 
port. A request for a connection from a client is routed 
using a destination address, A server daemon within the 
plurality of server daemons is selected to form a 
selected server daemon- The request is routed to the 
selected server daemon by changing the destination 
address to a server address for the selected server 
daemon. When a response is returned, source address in 
the response is changed to the original destination 
address . 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The novel features believed characteristic of the 
invention are set forth in the appended claims. The 
invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, wherein: 

Figure 1 is a pictorial representation of a 
distributed data processing system in which the present 
invention may be implemented is depicted; 

Figure 2 is a block diagram of a data processing 
system, which may be implemented as a server, in accordance 
to the present invention; 

Figrire 3 is a diagram of server system containing 
individual servers in which the processes of the present 
invention may be implemented in accordance with a preferred 
embodiment of the present invention; 

Figtire 4 is a diagram of data flow in a server in 
accordance with a preferred embodiment of the present 
invention; 

Figure 5 is a diagram of an IP header in accordance 
with a preferred embodiment of the present invention; 
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Figure 6 is a diagram of a TCP header in accordance 
with a preferred embodiment of the present invention; 

Figure 7 is a data structure in which information 
may be stored in responding to requests from clients in 
accordance with a preferred embodiment of the present 
invention; 

Figure 8 is a flowchart of a process for handling 
inbound packets in accordance with a preferred embodiment 
of the present invention; 

Figure 9 is a flowchart of a process for handling 
outbound packets in accordance with a preferred 
embodiment of the present invention; and 

Figure 10 is a connection record table in accordance 
with a preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



With reference now to the figures, and in particular 
with reference to Figiire 1, a pictorial representation of a 
distributed data processing system in which the present 
invention may be implemented is depicted. 

Distributed data processing system 100 is a network of 
computers in which the present invention may be implemented. 
Distributed data processing system 100 contains a network 
102, which is the medium used to provide communications links 
between various devices and computers connected together 
within distributed data processing system 100, Network 102 
may include permanent connections, such as wire or fiber 
optic cables, or temporary connections made through telephone 
connections. 

In the depicted example, a server system 104 is 
connected to network 102 along with storage unit 106, 
Server system 104 may include one or more servers connected 
to each other in the depicted example. In addition, 
clients 108, 110, and 112 also are connected to a network 
102 • These clients 108^ 110, and 112 may be, for example, 
personal computers or network con5>uters. For pvirposes of 
this application, a network ccxnputer is any computer, 
coupled to a network, vAiich receives a program or other 
application from another computer coupled to the network. 
In the depicted example, server system 104 provides data, 
such as, for example, boot files, operating system images, 
and applications to clients 108-112, Clients 108, 110, and 
112 are clients to server system 104. Distributed data 
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processing system 100 may include additional servers, 
clients, and other devices not shown. 

In the depicted exan^jle, distributed data processing 
system 100 is the Internet with network 102 representing a 
worldwide collection of networks and gateways that use the 
TCP/IP suite of protocols to communicate with one another. 
At the heart of the Internet is a backbone of high-speed 
data commxmication lines between major nodes or host 
computers, consisting of thousands of commercial, 
government, educational, and other computer systems, that 
route data and messages. Of course, distributed data 
processing system 100 also may be implemented as a number 
of different types of networks, such as for exarr^le, an 
intranet or a local area network. 

Figure 1 is intended as an example, and not as an 
architectural limitation for the processes of the present 
invention. 

Referring to Figure 2, a block diagram of a data 
processing system, which may be implemented as a server, is 
depicted in accordance to the present invention. In the 
instance that server system 104 is implemented as a single 
server, data processing system 200 may be used as the 
server. Data processing system 200 may be a symmetric 
multiprocessor (SMP) system including a plurality of 
processors 202 and 204 connected to system bus 206, 
Alternatively, a single processor system may be enployed. 
Also connected to system bus 206 is memory controller/cache 
208, which provides an interface to local memory 209, I/O 
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bus bridge 210 is connected to system bus 206 and provides 
an interface to I/O bus 212. Memory controller/cache 208 
and I/O bus bridge 210 may be integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 214 
is connected to I/O bus 212 and provides an interface to PCI 
local bus 216, A number of modems 218-22*0 may be connected 
to PCI local bus 216. Typical PCI bus implementations will 
support four PCI expansion slots or add-in connectors. 
Communications links to network computers 108-112 in Figure 
1 may be provided through modem 218 and network adapter 220 
connected to PCI local btis 216 through add-in boards. 

Additional PCI bus bridges 222 and 224 provide 
interfaces for additional PCI buses 226 and 228, from which 
additional modems or network adapters may be supported. In 
this manner, server 200 allows connections to multiple 
network computers. A memory mapped graphics adapter 230 and 
hard disk 232 may also be connected to I/O bus 212 as 
depicted, either directly or indirectly. 

Those of ordinary skill in the art will appreciate that 
the hardware depicted in Figure 2 may vary. For example, 
other peripheral devices, such as optical disk drive and the 
like also may be used in addition or in place of the hardware 
depicted. The depicted example is not meant to imply 
architectural limitations with respect to the present 
invention. 

The data processing system depicted in Figure 2 may be, 
for example, an IBM RISC/System 6000 system, a product of 
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International Business Machines Corporation in Armonk, New 
York, running the Advanced Interactive Executive (AIX) 
operating system. 

With reference now to Figure 3, a diagram of a server 
system is depicted in accordance with a preferred 
embodiment of the present invention. The -processes of the 
present invention are used within a single data processing 
system, such as the computer illustrated in Figure 2, In 
accordance with a preferred embodiment of the present 
invention, the processes of the present invention may be 
implemented in multiple servers as illustrated in Figure 3 
in a tiered configuration with other load balancing 
mechanisms. Server system 104 from Figure 1 in the 
depicted example is configured with a router 300^ a load 
balancing data processing system 302 and servers 304-308, 
Corresponding reference numbers in different figures 
represent corresponding components imless specified 
otherwise. Router 300 receives packets destined for server 
system 104 from network 102* Load balancing data 
processing system 302 routes packets received by router 300 
to an appropriate server from servers 304-308. In the 
depicted exan5)le, load balancing data processing system 302 
employs load balancing processes to maximize efficiency in 
processing requests from various clients. One or more of 
the servers in servers 304-308 may implement the processes 
of the present invention. These servers may be inplemented 
using a server such as data processing system 200 in Figure 
2. The server system illustrated in Figure 3 is not 
intended to imply architectural limitations to a server 
system implementation of the present invention. 
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The present invention provides a method, apparatus, 
and instructions for binding multiple server daemons in a 
server data processing system to the same IP address and 
port number. In particular, when a packet is received by 
the TCP/IP stack in a server, the TCP can pass the packet 
up to only one daemon which is listening on that address 
and port. The processes of the present invention changes 
the destination internet protocol (IP) address in the 
packet that is inbound or received by the server. An IP 
address is a 3 2 -bit (4 -byte) binary number that uniquely 
identifies a host (computer) connected to the Internet to 
other Internet hosts, for the purposes of communication 
through the transfer of packets. An IP address is 
expressed in "dotted quad" format, consisting of the 
decimal values of its four bytes, separated with periods; 
for example, 127,0.0.1. The first one, two, or three 
bytes of the IP address, assigned by InterNIC 
Registration Services, identify the network the host is 
connected to; the remaining bits identify the host 
itself. The 32 bits of all 4 bytes together can signify 
almost 232, or roughly 4 billion, hosts. This IP address 
is changed back to its original value when the packet is 
outbound or being sent out of the server. In this 
manner, a number of different server daemons may be used 
to handle packets destined for the same destination IP 
address . 

, Although the processes described are for 
implementation within a server, one or more of the 
servers in Figure 3 may implement the processes and 
instructions of the present invention in the 
configuration shown in Figtire 3 or in other 
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configurations in which multiple servers are placed into 
a tiered configuration with load balancing processes • 

With reference now to Figure 4, a diagram of data 
flow in a server is depicted in accordance with a 
preferred embodiment of the present invention. This 
figure illustrates the flow of packets through a server, 
such as one used in server system 104. Although Figure 4 
provides an example using TCP, the present invention is 
not limited to TCP and may be applied to other transport 
layer protocols, such as, for example. User Datagram 
Protocol (DDP) . Server 400 in Figure 4 receives packets 
from clients and sends packets back to clients. A packet 
402 is received at Internet Protocol (IP) layer 404. IP 
layer 404 incorporates the protocol within TCP/IP that 
governs the breakup of data messages into packets, the 
routing of the packets from sender to destination network 
and station, and the reassembly of the packets into the 
original data messages at the destination. IP corresponds 
to the network layer in the ISO/OSI model. 

Packet 402 is processed by IP layer 404 and passed 
on to dispatch layer 406, which provides the routing. 
mechanism used to route packets to different server 
daemons. In accordance with a preferred embodiment of 
the present invention, dispatch layer 406 is inserted 
between IP layer 404 and Transmission Control Protocol 
(TCP) layer 408. The mechanism incorporated within 
dispatch layer 406 allows for a number of server daemons, 
such as server daemons 410-414, to monitor or service the 
same IP address in fashion that is transparent to a 
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client. Dispatch layer 406 may change the destination IP 
address in packet 402 to route packet 402 to the 
appropriate server daemon if more than one server daemon 
is available to process requests made to the same 
destination IP address. 

When packets are sent back from a server daemon for 
transmission to a client, dispatch layer 406 will change 
the destination IP address back to the original address. 
Dispatch layer 406 tracks the changes, if any, to the 
destination IP address so that the destination IP address 
may be changed back to the original address when a packet 
is to be returned to the client. This feature of 
changing and restoring the destination IP address is 
transparent to the client. 

The packet sent from dispatch layer 406 to TCP layer 
408, which includes the protocol within TCP/IP that 
governs the breakup of data messages into packets to be 
sent via IP, and the reassembly and verification of the 
complete messages from packets received by IP* TCP 
corresponds to the transport layer in the ISO/OSI model. 
TCP layer 408 sends the packet to a server daemon, such 
as server daemons 410-414, depending on the destination 
IP address in the packet. 

When a packet, such as packet 416, is sent from one 
of the server daemons for transport to a client, TCP 
layer 408 will receive the packet and process it 
according to TCP protocols. Packet 416 is then sent to 
dispatch layer 406, which will determine if the 
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destination IP address for the incoming packet to the 
server daemon was changed. If the destination IP address 
was changed, the destination IP address in packet 416 is 
changed back to the original address. Packet 416 will 
then be passed to IP layer 404 for processing and then 
sent to the client. 

Although the depicted example, dispatch layer 406 is 
located between TCP layer 408 and IP layer 404, dispatch 
layer 406 may be located in other places below TCP layer 
408. For example, dispatch layer 406 could be located 
below IP layer 404, In addition, the processes in 
dispatch layer 406 could be implemented within IP layer 
404 itself. 

Turning to Figure 5, a diagram of an IP header is 
illustrated in accordance with a preferred embodiment of 
the present invention. This configuration 540 shows 
organization of an IP header and IP data area. 
Configuration 540 is shown as a sequence of 32 bit words. 
The first six words in the sequence are the IP header 544 
and the remaining words are in IP data area 546. The 
numbers 542 across the top of the configuration 540 show 
the starting bit location of the various fields in the 
words of the IP message. The IP fields of particular 
interest are the protocol field 547, source IP address 
field 548, and destination address field 549. Each data 
processing system using IP is assigned a globally luiique 
IP address. The protocol field 547 gives information 
about the protocol used in the next highest layer of 
protocol. For instance, the protocol field 547 specifies 



CR9-98-041 



15 



if the next highest level will use DDP, TCP, or another 
protocol. The source IP address field 548 specifies the 
address of the computer which originated the message. 
The destination address field 549 specifies the address 
of the computer which is to receive the message. Other 
fields in the IP header, like total length and fragment 
offset, are used to breakup network datagrams into 
packets at the source computer and reassemble them at the 
destination computer. The header checksum is a checksum 
over the fields of the header, computed and set at the 
source and recomputed for verification at the 
destination , 

Next in Figure 6, a diagram of a TCP header is 
illustrated in accordance with a preferred embodiment of 
the present invention. The TCP format is shown as a 
sequence of 32 bits words, the first six words being the 
TCP header 666 and the remaining words being the TCP data 
667. . The numbers 662 across the top of the TCP format 
660 represent the starting bit locations of the fields in 
the TCP header 666. The TCP header 666, being a port 
type protocol, has port information in its header 
including a source port 663 and a destination port 664. 

A TCP connection from a port on the source machine 
to a port on a destination machine is defined by four 
values: source address 648, source port 663, destination 
address 640, and the destination port 664 of the remote 
port of that machine. When the TCP protocol layer 
receives a TCP datagram, it uses all four values to 
determine which connection the data is for. Thus, on any 
one machine, TCP ensures that the set of active 
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connections is iinique* TCP ports are not required to be 
unique. The same TCP port may be used in multiple 
connections, as long as those connections are unique. 

The dispatcher is configured to store information 
describing which server daemons are available to be used 
when responding to requests from clients. One possible 
configuration implementation is shown in Figure 7 as a 
"'tree view" • Turning now to Figure 1, a data structure 
in which information may be stored in responding to 
requests from clients is depicted in accordance with a 
preferred embodiment of the present invention. Data 
structure 700 relates the cluster address and port 
number, as targeted by the client, with the set of server 
daemon addresses within the server machine. Practical 
configurations can range from a single cluster, single 
port, and two servers, to multiple clusters, multiple 
ports, and multiple servers. In addition, ports can be 
configured to support TCP only, DDP only, other 
protocols, or all protocols. 

With reference now to Figiare 8, a flowchart of a 
process for handling inbound packets is depicted in 
accordance with a preferred embodiment of the present 
invention. In the depicted example, this process is 
employed by dispatch layer 406 in Figtire 4 to process a 
packet received by a server having multiple daemons 
designated to handle the same destination IP address. The 
process begins by receiving a packet from the IP layer 
(step 800) . A determination is made as to whether the 
destination IP address of the packet matches a ND cluster 
address and whether the destination TCP port matches a M) 
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port. Step 802 is performed by consulting a ND 
configuration. In the depicted examples, a "'cluster 
address'' is an IP address knovm to clients as an address 
of the target. The cluster address is used by the client 
to access or send requests to the target. Referring to 
the dispatcher data structure in Figure 7, the 
destination IP address in the received packet is first 
considered. If the destination address matches a 
configured dispatcher cluster address, then the port 
numbers are considered. If the destination port number 
in the packet matches one of the port numbers configured 
under that cluster address, then the packet will be 
handled by the dispatcher. 

Then, a determination is made as to whether the 
packet is part of an existing TCP connection (step 804) . 
The determination in step 804 is made by consulting a 
connection record table maintained by dispatch layer 406, 
which is described in more detail below in Figure 10, If 
the packet is not part of an existing connection, a 
daemon server is selected (step 806) , This selection may 
be made in a nximber of ways. The selections may be, for 
example, performed in a round robin mechanism or using 
any other known load balancing mechanisms. These load 
balancing mechanisms can range from simple round robin 
techniques, to sophisticated weighted round robin 
algorithms with active management processes. In the 
simple roimd robin case, each new client request is 
forwarded to the next server daemon in the configuration, 
regardless of the number of connections previously sent 
to that searver, and regardless of whether that server is 
Still responding properly. More sophisticated select 
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servers based upon information provided by their active 
management processes. These processes monitor the number 
of new connections sent to each ser^rer, the number of 
connections presently active on each server, and the 
health of each server (via other active processes which 
periodically assess the response time or another 
parameter of each server daemon) . This .information is 
then combined and used by the load balancing algorithm to 
select a server daemon within the server to service the 
connection. 

Using the selected server, a new record is then 
added to the connection record table (step 808) * Next, 
the destination IP address of the packet is translated 
from the cluster address (the current value of the 
destination IP address in the packet) to the address of 
the server daemon selected to process the connection 
(step 810) • A new IP checksum is then calculated for the 
packet taking into accoxHit the destination IP address of 
the server daemon (step 812) . The packet is then 
forwarded to TCP layer 408 (step 814) . 

With reference again to step 804, if the packet is 
part of an existing connection, the address of the 
previously selected server is selected from the table 
(step 816) with the process then proceeding to step 810 
as previously described. Referring back to step 802, if 
the destination IP address and the destination TCP port 
of the packet both do not match a ND cluster address and 
a ND port, the packet is forwarded to TCP layer 408 in 
Step 814. This occurs when a packet is not destined for 
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a connection that has multiple server daemons assigned to 
handle the connection • 

Turning next to Figure 9, a flowchart of a process 
for handling outboimd packets is depicted in accordance 
with a preferred embodiment of the present invention. In 
the depicted example, this process is employed by 
dispatch layer 406 in Figure 4 to process a packet that 
is to be sent to a client from a server having multiple 
daemons designated to handle the same destination IP 
address- 

The process begins by receiving a packet from the 
TCP layer (step 900) • A determination is made as to 
whether the destination IP address of the packet matches 
one of the server addresses and whether the source TCP 
port matches a ND port. Step 902 is performed by 
consulting a ND configuration. If the source IP address 
matches the ND server address and the source TCP port 
matches a ND port, a determination is made as to whether 
the packet is part of an existing TCP connection (step 
904) • The determination in step 904 is made by 
consulting the connection record table, which is 
described in more detail below in Figure 10. If the 
packet is part of an existing connection, the cluster 
address is obtained from the table (step 906) • In the 
depicted example, the cluster address is obtained from 
the connection record table. Then, the source IP address 
of the packet is translated from the server daemon 
address to the cluster address (step 908) . A new IP 
checksum is then calculated for the packet taking into 
accotmt the destination IP address of the server daemon 
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(step 910) , The packet is then forwarded to IP layer 404 
(step 912) . IP layer 404 processes the packet for 
transmission to the client . 

With reference again to step 904, if the packet is 
not part of an existing connection, the process then 
proceeds to step 912 as described above,' Referring back 
to step 902, if the source IP address and the source TCP 
port of the packet both do not match a ND sever and a ND 
port, the packet is forwarded to IP layer 404 in step 
912. This occurs when a packet is not destined for a 
connection that has multiple server daemons assigned to 
handle the connection. Some addresses may not be for 
server daemons or are not for connections that are 
assigned more than one server daemon. 

Turning now to Figxire 10, a connection record table is 
illustrated in accordance with a preferred embodiment of 
the present invent ion. Connection record table 1000 
includes a number of records 1002, also referred to as 
entries. Each record 1002 includes form the received 
packet a source IP address 1004, a destination IP address 
1006, a source TCP port 1008, and a destination TCP port 
1010. Each record 1002 also includes the address of the 
server 1012 selected by the load balancing mechanism. Each 
record 1002 provides a mapping between the packets which 
f low^ to and from the client and the packets which flow to 
and from the server daemons* 

In connection with steps 804 and 808 in Figxire 8, 
records are added to the connection record table 1000 each 
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time a new connection is established. The two IP addresses 
and two port numbers from the received packet are copied 
into in the new entry. Following the load balancing's 
selection of a server daemon, that server's address is then 
added to the connection table entry. Then, per step 810, 
the destination IP address field of the received packet is 
changed to that of the selected server* .When a connection 
is terminated, the connection record is removed from the 
table* Garbage collection mechanisms are also used to 
purge from the table any stale connections which have not 
terminated gracefully. Connection record table 1000 is 
employed to track connections and server daemons used to 
service the connections. 

Through the use of connection record table 1000, 
dispatch layer 406 can track which daemon is servicing a 
particular connection and make the appropriate destination 
IP address translations to route incoming packets to the 
appropriate server daemon. With outgoing packets, 
connection record table 1000 is used by dispatch layer 406 
to restore the source IP address to the one that was used 
by the client. The restoration of the source IP address in 
outgoing packets provides seamless handling of packets in 
^^binding" or assigning multiple daemons to the same IP 
address and port nximber. Thus, a niamber of daemons can 
listen on the same address and port to provide increased 
capacity within a single server. 

Further, dispatch layer 406 can be used to support 
multiple IP destination addresses. Multiple cluster 
addresses with different groups of multiple server 
daemons may be handled using the processes of the present 
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invention. Thus, the present invention provides for 
scalable capabilities within a server. 

It is important to note that while the present 
invention has been described in the context of a fully 
functioning data processing system, those of ordinary 
skill in the art will appreciate that the processes of 
the present invention are capable of being distributed in 
a form of a computer readable medium of instiructions and 
a variety of forms and that the present invention applies 
equally regardless of the particular type of signal 
bearing media actually used to carry out the 
distribution. Examples of computer readable media 
include recordable -type media such a floppy disc, a hard 
disk drive, a RAM, and CD-ROMs and transmission- type 
media such as digital and analog communications links • 

The description of the present invention has been 
presented for purposes of illustration and description, 
but is not limited to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 
variations will be apparent to those of ordinairy skill in 
the art. For example, the present invention is not 
limited to the traditional web server, using HTTP on port 
80, but may be applied to support multiple protocols 
and/or port nxombers. The embodiment was chosen and 
described in order to best explain the principles of the 
invention, the practical application, and to enable 
others of ordinary skill in the art to understand the 
invention for various embodiments with various 
modifications as are suited to the particular use 
contemplated . 
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What is claimed is: 

II, A method in a data processing system for binding a 

2 plurality of processes to a destination address , the 

3 method comprising the data processing system implemented 

4 steps of: 

5 receiving a request for a connection, wherein the 

6 request includes a destination address; 

7 selecting a process from the plurality of processes 

8 to form a selected process; 

9 changing the destination address in the request to 

10 an address for the selected process; and 

11 sending the request to the selected process using 

12 the address for the selected process, 

1 2, The method of claim 1 further comprising: 

2 detecting a response from the selected process, 

3 wherein the response includes a source address; and 

4 changing the source address to the destination 

5 address . 

1 3. The method of claim 1, wherein the plurality of 

2 processes is a plxxrality of server daemons, 

1 4, .The method of claim 1, wherein further comprising: 

2 creating a record in a table, wherein the record 

3 provides mapping between packets flowing to and from a 

4 client and between packets flowing to and from the 

5 selected process. 
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1 5, The method of claim 4, wherein each record includes 

2 a source IP address , a destination IP address, a source 

3 TCP port, a destination TCP port, and an address of the 

4 selected process. 

1 6. The method of claim 1, wherein the step of selecting 

2 a process is performed using a load balancing process. 

17, A method in a data processing system for routing 

2 packets from a client to a selected process within a 

3 plurality of processes servicing a connection between the 

4 data processing system and the client, the method 

5 comprising the data processing system implemented steps 

6 of: 

7 receiving a packet for the connection between the 

8 data processing system and the client, wherein the packet 

9 includes a destination address; and 

10 translating the destination address to an 

11 intemediate destination address, which is an address for 

12 the selected process within the plurality of processes, 

1 8. The method of claim 7, wherein the translating step 

2 is performed using a table that provides mapping between 

3 packets which flow to and from the client and between 

4 packets that flow to and from the plurality of processes. 

1 9* The method of claim 7, wherein the plurality of 

2 processes comprise a plurality of server daemons. 
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1 10. The method of claim 7, wherein the table includes a 

2 record for each connection. 

1 11, The method of claim 10 further comprising: 

2 detecting a termination of a connection; and 

3 removing a record from the table in- response to a 

4 termination of a connection associated with the record, 

1 12. A method in a computer for routing packets between a 

2 plurality of server daemons on the computer and a client, 

3 the method comprising the computer implemented steps of : 

4 receiving a packet from a client, wherein the packet 

5 includes a destination address; 

6 determining whether a connection exists for the 

7 client; 

8 responsive to a determination that a connection is 

9 absent for the client, selecting a server daemon from the 

10 plurality of server daemons to service the client, 

11 wherein the plurality of server daemons service the 

12 destination address in the packet and wherein the 

13 plurality of server daemons have assigned destination 

14 addresses ; and 

15 altering the destination address in the packet to an 

16 assigned destination address for the server daemon. 

1 13, The method of claim 12 further comprising: 

2 sending the packet to the server daemon using the 

3 assigned destination address. 
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1 14, The method of claim 13 further comprising: 

2 receiving a return packet for the client from the 

3 server daemon, wherein the return packet includes a 

4 source address; and 

5 altering the source address in the return packet to 

6 that of the destination address, 

1 15, The method of claim 12 further comprising: 

2 responsive to selecting the server daemon, creating 

3 a record in a table in which the record includes an 

4 address of the server daemon and the destination address, 

1 16. A system in a data processing environment 

2 comprising: 

3 a plurality of processes, wherein the plurality of 

4 processes service a destination address and have process 

5 addresses ; 

6 a packet routing layer, wherein the packet - routing 

7 layer routes a packets to the plurality of processes 

8 using a destination addresses within the packets; 

9 a dispatch layer, wherein the dispatch layer has a 

10 plurality of modes of operation including: 

11 a first mode of operation in which the dispatch 

12 layer receives a packet from a client, wherein the packet 

13 includes the destination address; 

14 a second mode of operation, responsive to 

15 receiving the packet, in which the dispatch layer 

16 identifies a process within the plurality of processes to 
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17 service the client, wherein the process is an identified 

18 process; 



19 a third mode of operation in which the dispatch 

20 layer translates the destination address to a 

21 process address for the identified process within 

22 the plurality of processes; and 

23 a fourth mode of operation, responsive to the 

24 third mode of operation, in which the packet is sent 

25 to the packet routing layer. 



1 17, The system of claim 16, wherein each packet includes 

2 a source address and wherein the dispatch layer further 

3 includes: * 

4 a fifth mode of operation in which the dispatch 

5 layer receives a packet from the identified process for 

6 the client; and 

7 a sixth mode of operation , responsive to the 

8 fifth mode of operation, in which the dispatch layer 

9 translates the source address in the packet of the 
10 destination address. 

1 18, The system of claim 16, wherein the second mode of 

2 operation includes: 

3 a first submode of operation in which a 

4 determination is made as to whether a connection exists 

5 for the client; 

6 a second svtbmode of operation, responsive to a 

7 determination that a connection is absent for the client 

8 in the first submode of operation, in which a connection 

9 is created and a process within the plurality of 
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10 processes is assigned to service the connection, wherein 

11 the process is the identified process; and 

12 a third sx±nnode of operation, responsive to a 

13 determination that a connection exists for the client, in 

14 which a process assigned to the connection is identified 

15 and forms the identified process, 

1 19. The system of claim 16, wherein the packet routing 

2 layer is a transmission control protocol layer, 

1 20, The system of claim 16, wherein the plurality of 

2 processes is a plurality of server daemons. 

1 21, A data processing system for binding a plurality of 

2 processes to a destination address, the data processing 

3 system comprising: 

4 receiving means for receiving a request for a 

5 connection, wherein the request includes a destination 

6 address; 

7 selection means for selecting a process from the 

8 plurality of processes to form a selected process; 

9 changing means for changing the destination address 

10 in the request to an address for the selected process; 

11 and 

12 . sending means for sending the request to the 

13 selected process using the address for the selected 

14 process . 
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1 22. The data processing system of claim 21, wherein the 

2 changing means is a first changing means and further 

3 comprising: 

4 detection means for detecting a response from the 

5 selected process, wherein the response includes a source 

6 address; and 

7 second changing means for changing the source 

8 address to the destination address, 

1 23, The data processing system of claim 21, wherein the 

2 plurality of processes is a plurality of server daemons. 

1 24, The data processing system of claim 21, wherein 

2 further comprising: 

3 creation means for creating a record in a table, 

4 wherein the record provides mapping between packets 

5 flowing to and from a client and between packets flowing 

6 to and from the selected process, 

1 25, The data processing system of claim 24, wherein each 

2 record includes a source IP address, a destination IP 

3 address, a source TCP port, a destination TCP port, and 

4 an address of the selected process. 

1 26. The data processing system of claim 21, wherein the 

2 selection means is perfomned using a load balancing 

3 process. 
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1 27, A data processing system for routing packets from a 

2 client to a selected process within a plurality of 

3 processes servicing a connection between the data 

4 processing system and the client, the data processing 

5 system comprising: 

6 receiving means for receiving a packet for the 

7 connection between the data processing system and the 

8 client, wherein the packet, includes a destination 

9 address; and 

10 translating means for translating the destination 

11 address to an intermediate destination address, which is 

12 an address for the selected process within the plurality 

13 of processes, 

1 28. The data processing system of claim 27, wherein the 

2 translating means perfoirmed using a table that provides 

3 mapping between packets which flow to and from the client 

4 and between packets that flow to and from the plurality 

5 of processes. 

1 29. The data processing system of claim 27, wherein the 

2 plurality of processes comprise a plurality of server 

3 daemons . 

1 30. , The data processing system of claim 27, wherein the 

2 table includes a record for each connection. 
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1 31. The data processing system of claim 30 further 

2 comprising: 

3 detection means for detecting a termination of a 

4 connection; and 

5 removing means for removing a record from the table 

6 in response to a termination of a connection associated 

7 with the record, 

1 32, Computer readable code for routing packets between a 

2 plurality of server daemons on a computer and a client, 

3 said computer readable code comprising: 

4 first subprocesses for receiving a packet from a 

5 client, wherein the packet includes a destination 

6 address ; 

7 second subprocesses for determining whether a 

8 connection exists for the client; 

9 third siabprocesseS/ responsive to a determination 

10 that a connection is absent for the client, for selecting 

11 a server daemon from the plurality of server daemons to 

12 service the client, wherein the plurality of server 

13 daemons to service the destination address in the packet 

14 and wherein the plurality of server daemons have assigned 

15 destination addresses; and 

16 fourth subprocesses for altering the destination 

17 address in the packet to an assigned destination address 

18 for the server daemon, 

1 33, The computer readable code of claim 32 further 

2 comprising: 
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3 fifth subprocesses for sending the packet to the 

4 server daemon using the assigned destination address, 

1 34, The computer readable code of claim 32 further 

2 comprising: 

3 sixth siibprocesses for receiving a .return packet for 

4 the client from the server daemon, wherein the return 

5 packet includes a source address; and 

6 seventh subprocesses for altering the source address 

7 in the retuim packet to that of the destination address, 

1 35, The computer readable code of claim 32 further 

2 comprising: 

3 eighth subprocesses, responsive to selecting the 

4 seirver daemon, for creating a record in a table in which 

5 the record includes an address of the server daemon and 

6 the destination address, 

1 36, A computer program product for binding a plurality 

2 of processes to a destination address, the computer 

3 program product comprising: 

4 a coitputer readable medium; 

5 first instructions for receiving a request for a 

6 connection, wherein the request includes a destination 

7 address; 

8 second instructions for selecting a process from the 

9 plurality of processes to form a selected process; 



CR9-98-041 



33 



10 third instructions for changing the destination 

11 address in the request to an address for the selected 

12 process; and 

13 fourth instructions for sending the request to the 

14 selected process using the address for the selected 

15 process, 

16 wherein the instructions are embodied within the 

17 computer readable medium. 



1 37, The computer program product of claim 36 further 

2 comprising: 

3 fifth instructions for detecting a response from the 

4 selected process, wherein the response includes a source 

5 address; and 

6 sixth instructions for changing the source address 

7 to the destination address. 

1 38. A computer program product for routing packets from 

2 a client to a selected process within a plurality of 

3 processes servicing a connection between the data 

4 processing system and the client comprising: 

5 a computer readable medium; 

6 first instructions for receiving a packet for the 

7 connection between the data processing system and the 

8 client, wherein the packet includes a destination 

9 address ; and 

10 second instructions for translating the destination 

11 address to an inteinnediate destination address, which is 

12 an address for the selected process within the plurality 

13 of processes. 
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wherein the instructions are embodied within the 
computer readable medium 
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ABSTRACT 

METHOD Mm APPARATUS LOAD BALANCING 
SERVER DAEMONS WITHIN A SERVER 

A method and apparatus in a data processing system 
5 for binding a plurality of server daemons to a 

destination address and port, A request for a connection 
from a client is routed using a destination address, A 
server daemon within the plurality of server daemons is 
selected to form a selected server daemon. The request 
10 is routed to the selected searver daemon by changing the 
destination address to a server address for the selected 
server daemon. When a response is returned, source 
address in the response. is changed to the original 
destination address. 
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